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INTRODUCTION 



ranee V of a n ti0nal v! dUCati ° n includes preparation for a wide 
range of occupations. The teachers for vocational oroarL, 

tilLi* reCrUited from industry and allied fields. Occupa- 
tional competency evaluation through written a „,i * P 
competency tests assure 8 * en and Performance 

possess fh» i i ® es that prospective vocational teachers 
possess the level of competence essential for effective 
teaching m various vocational programs. 



While there are many occupational areas with certain 
characteristics which require special considerations the 
p^ fa effort of the National Occupational Competency Testing 

all J tests e to l beV ‘T* develo P ment Procedure consistent for 
tests to be developed under its sponsorship. 



vpln °^ rin f Pha ? a 1 ° f the Project such a procedure was de- 
veloped and field tested. it has been refined by thlproiect 

Comfit t p! VleW H d th ! Princi P al Investigators and PlaLing 
Committee, and adopted for the development of the tests 
scheduled for Phase II. tests 



inis material 



the direct UI cnree Parts: Part One covt.o 

the directions for area test center coordination Part Two 

re ates to the actual test development, and Part Three the 

»nd performance teats. rich section 
. es J he function of the individuals involved sequence of 

r ri zrxs.'ztts.'zx'zjz* 



Dr. Carl Schaefer 



New Brunswick, New Jersey 
Api'il 1971 



4 



1 i 



CONTENTS 



Page 



PLANNING COMMITTEE . . 

INTRODUCTION . 



PART ONE: AREA TEST CENTER COORDINATION 



I. DIRECTIONS FOR THE AREA TESTING CENTER ADMINISTRATOR. 1 



A. The Area Test Center Concept 

B. Utilization of Test Results 

C. The Role of the Area Test Center Coordinator 

D. Materials to be Developed and Coordinated as Part 

of the Test Development: Procedures .... 

E. Suggested Organization of the Planning Committee 

F. The Responsibility of the Planning Committee 

G. Report and Work Forms for the Committee . 

II. OCCUPATIONAL JOE CLUSTER PROCEDURE 

A. Determination of Job Titles in a Job Cluster 

B. Determination of Proficiency Levels ... 

III. PREPARATION OF THE SCOPE OF THE EXAMINATION . 

A. Grid or Content Specification 

B. Length of the Written Examination 



6 



9 



IV. OCCUPATIONAL JOB CLUS~ vSI ... 

a. Cluster Analysis for Skills and Information 



14 



V. STEPS IN EVALUATING THE WRITTEN -PORT . 

A. Preliminary Testing. . . . 

B. Pilot Testing of the Written LXcmination. 

C. Evaluation of Pilot Test Results for Final 

Revision . . . . 

'D. Final Form of the Written Examination 

VI. STEPS IN EVALUATING THE PERFORMAN" L TEST . . . 

A. Preliminary Testing of the Performance Test 

B. Pilot Testing the Performance lest 

C. The Completed Performance Tes.: 



16 



16 



5 



iii 



PART TWO: 



TEST DEVELOPMENT 



Page 



II. 

III. 

IV. 

V. 

PART 

I. 

II. 
III. 



DIRECTIONS FOR THE TEST DEVELOPER 



A. Information and Resources for Written Test item 

Preparation ' icem 

B. Test Item Form - Written Examination.' ’ 

C. Construction of the Performance Test 

D. Constructing the Written Test . 

WRITTEN EXAMINATION REPORT 



A. Organizing the Examination . 

B. Preparation of an Answer Sheet. 

CONSTRUCTING THE PERFORMANCE EXAMINATION. 



A. 

B. 

C. 

D. 



Selection of Skills for the Work Job. 

Selection of Work Jobs .... 

Description of Work Jobs. . 

Directions to the Candidate for the Performance Test 



EVALUATING THE RESULTS OF A PERFORMANCE TEST 
A. Developing a Rating Form. 



18 



19 



24 



29 



DIRECTIONS TO THE EXAMINER 



THREE. ADMINISTERING OCCUPATIONAL COMPETENCY 
EXAMINATIONS 

GENERAL INFORMATION FOR THE EXAMINERS 

A. Testing Procedures 

B. Identification of Candida :es 

DIRECTIONS FOR ADMINISTERING THE WRITTEN EXAMINATION. 

A. Things for the Proctor to Do Prior to the 
Examination .... 

B. Before the Examination Begins 

C. . Distribution of Examinations , 

D. What to Do During the Examinat ion # Per iod ‘ 



DIRECTIONS FOR ADMINISTRATION OF PERFORMANCE EXAMINATIONS. 



46 



A. 

B. 

C. 

D. 

E. 

F. 



Facilities for Examinations 
Supplies for Testing . 

What to Do Before the Day of the Examination 
What to Do During the Examination. 

What to Avoid During the Examination. 

At the Close of the Examination .... 
Completing the Scoring of the Examination 



iv 



ILLUSTRATIONS: 



Page 



% 




1 . Planning Committee Work Schedule 4 

2A . Job Cluster for Five Major Levels of Occupational 
Proficiency for Electronic Industries Occupations 
(Communications) 7 

3. Directions to the Candidate - Scope of the Written 

and Performance Examination 10 

4. Scope of the Written Examination n 

5. Scope of the Performance Examination 12 

6. Directions to the Candidate - Format for Cover 



Page of the Written Examination 21 

7. Sample Page for Written Examination 22 

8 . Key to Answers for Written Test 23 

9. Directions to the Candidate - Performance Test . . 27 

10. Sample Performance Test 30 

11. Sample Rating Sheet - Machine Industries Occupations 

(Machine Trades) 32 

12. Sample Rating Sheet - Electronics Industries 

Occupations (Communications) 35 

13. General Directions to the Examiner - 

Performance Test 35 

14. Listing of Machines, Accessories and Materials 

Required for a Job 41 

15. Listing of Tools, Accessories and Materials 

Required for the Performance Test 42 



16. Examination Report: Preliminary Check- List for 

Performance Examination 50 

17. Report Sheet - Irregularities During the Performance 

Examination 51 



7 



v 



WORK SHEETS: 



Page 



I. 

II. 
HI. 

IV. 

V. 

VI. 

VII. 

VIII. 

IX. 



X. 



Summary Report Form of Planning Committee 

° * • • • 

Work Sheet for Listing Job Clusters 

• • ■ • • 

Work Sheet for the Scope of the Written Examination. 

Work Sheet for Job Cluster Analysis . 

Card Format for Recording the Examination Items 

Determining the Skills and Methods Applied to 
the Performance Test . 

Selection of Manipulative Skills for the 
Performance Test 

Evaluation Form for Work Method and Finished 
Work Piece Evaluation 

Evaluation Form Work Sheet for Troubleshooting 
or Diagnostic Techniques. 

Directions to Examiner - Machines, Accessories, 
and Equipment 5 



5 

8 

13 

15 

20 

25 

26 
31 
34 
38 



O 

ERIC 



vi 



PART ONE 



AREA OCCUPATIONAL COMPETENCY TEST CENTER COORDINATION 

I. DIRECTIONS FOR THE AREA TESTING CENTER ADMINISTRATOR 

A. The Area Test Center Concept 

The area occupational competency tect center serves as the 
regional representative for the National Occupational Competency 
Testing Program, At the present time each test center will develop 
one or more written and performance tests for a selected occupa- 
tional area. Eventually, these centers might function as the 
regional agency through which all available tests are administered 
for a geographic area. 

It must be emphasized that the centers currently identified are 
serving as pilots. The numbers, location and administration of Area 
Occupational Competency Testing Centers will be consistent with plans 
developed by the Consortium of States, with freedom of acceptance and 
participation determined by individual states. 

B . Utilization of Test Results 

The occupational competency test results will serve three major 
purposes of which the area test center coordinator must be aware. 

The results may be used as: 

!• a prerequisite for admission to a preservice or in-service 
industrial teacher education program, and/or 

2. a regular means for temporary and/or permanent certification, 
and/or 

3. the basis for granting college credit for specialization 
content areas in degree programs. 

The results of such tests are also used for prognostic and 
diagnostic purposes to determine weak or deficient content areas which 
the candidate needs to correct or improve. 

C . The Role of the Area Test Center Coordinator 

The overall responsibility for developing the written and per- 
formance test rests with the area test center coordinator. Ha must 

1. organize the planning committee, 

2. provide the direction for the work of the planning committee, 

3. select the individuals competent to make the content analysis 
and write the test items, 

r : ' 

4. arrange for the necessary clerical and other technical 
service. 
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arrange for the physical facilities to try out or pilot 
test the written, and performance tests, 

6. arrange for the revision and correction of the tests for 
final copy, 

7. select the examiners and proctors for the pilot testing of 
the written and performance tests, 

8. administer the test and be responsible for reporting 
results, and 

9. act as coordinator between the individuals involved in test 
development and the National Project. 

Materials to be Developed and Coordinated as Part 
of the Test Development Procedure 

The final Written and Performance Tests must be supported by the 
following activities and materials: 

1. A listing of job titles in clusters of the occupation 
according to major job level classifications and the levels 
of competency to be tested; 

2. A determination of job cluster levels for which competency 
is to be determined; 

3. An analysis of the job clusters showing the manipulative 
skills, methods, procedures and the necessary occupational 
and related technical information that constitute competence 
at the journeyman level or its equivalent; 

4. The Scope of the examination for the written and performance 
test; XThis is information for the candidate.) 

5. The Written Examination, including an alternate form; 

6. Test Rating Form for the Written Examination; 

7. The Performance Examination, including an alternate form: 

a) Performance Evaluation Form 

b) Directions to the Candidate 

c) Directions to the Examiner, pertaining to setting up 
machinery, equipment, etc., and the materials re- 
quired for the performance test 

8. Completed answer and Evaluation Form for all candidates for 
statistical evaluation. 
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Suggested Organ ization of the Planning Committe e 

1. Such a conmittee should consist of representatives from 
industry, teacher educator, qualified vocational teacher 
and a test specialist. 

2. Such a committee should not exceed seven In number. 

3* Various branches of the Industry or occupational area 
should be represented. 

4. Care should be exercised that the members of the commit- 
tee are drawn from as wide a geographic area as is prac- 
tical to represent sectional differences in the occupa- 
tion, if they exist. 

The Responsibility of the Planning Committee 

The memoers of the Planning Conmittee must be provided with an 
outline of the work to be completed and the results expected. The 
outline should include specific tasks to be completed by the members 
of the committee: 

1. Developing an overall statement of test purpose and 
objective of the examination, 

2. Defining Job Clusters for the occupational areas to 
be tested, 

3. Setting of proficiency levels within the Job Clusters 
area which are to be evaluated by the. tests, 

4. Establishing certain standards against which test results 
are to be evaluated, 

** • Providing direction for the analysis of the occupational 
®kills» knowledge and information from which the scope, 
test grid and examination items are to be developed. 

Report and Work Forms for the Committee 

Illustration 1 ^following page) is a sample of the Planning 
Committee Work Schedule. 

Work Sheet 1 has been effectively used to report the work of 
the Planning Committee. 



NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 



Meeting Date 
Part icipants 



Illustration 1 

Planning Committee Work Schedule 



Place 



Time 



1. Development of Test Purpose and Objectives of the Written Examination 

for (Occupational Area) . 

2. Listing and Grouping of Job Clusters to be considered for the Examin- 
at ion : 

Resources: Dictionary of Occupational Titles - 

Listing of Occupational Programs of the U. S. Office of Education 
Job Descriptions of Employer and Trade Associations. 

These complement the occupational analyses of the test developer. 

3. Defining of Competency Levels of the Job Clusters: 

The job levels to be included for content analysis. 



4. 



Defining the scope and directions for the skills, technica 
occupational information from which the examination item."-, 
test tasks, evaluation form and instructions to candidates 
ers must be developed. 



1 and related 
performance 
and examin- 
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WORK SHEET I 



NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 
SUMMARY REPORT OF PLANNING COMMITTEE 



Title of the Examination __ 
The Written Examination in 



Time Limit 

__ includes 



test items of the multiple-choice form. 



The test items are prepared for the following occupational areas and compe- 
tency levels. 



Major Area 



Competency Level 



Number of Test Items 



A sufficient number of test items must be prepared to provide for alternate 
forms of the examinations. 

The Performance Examination in is of 

_ Finished Product or Troubleshooting type. 

Time Limit 

Overall Objectives and Scope of the Examination: 





II. OCCUPATIONAL JOB CLUSTER PROCEDURE 



Determination of Job Titles in a Job Cluster 

The occupational job clusters constitute the framework for 
any occupational competency examination. Care and effort must 
be devoted to the identification of Jobs which form an occupa- 
tiona ^ cluster. A thorough analysis of job titles, the skill 
and reii-ted technology represents the first step. This can be 
done from an assessment of Dictionary of Occupational Titles, 
job descriptions by employers, other U. S. Department of Labor 
sources, and trade groups. 

These occupational job clusters must show the relationship 
of the jobs to each other and the varying degrees of competence 
in an occupational area. For example, in the Machine Industries 
Occupations there are specialist operators, all-around operators, 
setup men, skilled tradesmen (Machinist - Tool and Die Maker), 
and Technicians. Illustration 2A shows an example of Job Cluster 
Groupings according to estimated interrelationships for the 
Electronic Industries Occupations (Communications). 



Determination of Proficiency Levels 

The proficiency levels set the range for the test items to 
be developed. The occupational job clusters enable the committee 
to identify the proficiency levels which are to be evaluated. 
Illustration 2A shows the job clusters established by the commit- 
tee for which test items for the Written Test and the Performance 
Test are to be prepared. Levels II, in and IV were identified 
as the range of competency to be evaluated. Work Sheet II is 
suggested for the listing of the major areas and their subdivi- 
sions for test item writing. This work sheet provides the common 
elements for all levels and the additional items that distinguish 
the levels of competency. 
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III. PREPARATION OF THE SCOPE C THE EXAMINATION 



Grid or Content Specification 

The content analysis provides the : :al competence content of the 

Job Clusters. A test merely represent? sampling through selected 
items of the overall cor petence. 

A grid or specif icacion provides th-* framework around which the 
test is built. It consists of a gr upir ^ of major areas of the content 
of the cluster of occupation. The planning and/or test item develop- 
ment committee will assign priorities to each grouping to show their 
importance. These priorities, expressed in percentages (Group A - 157, 
Group B - 254, Group C - 5%) of the total examination show the signifi- 
cance and relationships of the groupings to each other and their part 
in the total competence of the occupation. 

This grid serves, also, as the scope cf the examination which must 
be provided for the candidate who wishes to take the examination. 

Illustrations 3-4-5 represent the scope of the written and 
performance examination which is providec to the candidate. 

Work Sheet IV serves the planning committee to develop a complete 
scope for the written and performance examination. 



Length of the Written Examination 

While it is difficult to determine the exact length of an examina- 
tion, experience has shown that a range of 135-165 test items produces 
satisfactory results in terms of sampling, reliability, and validity. 
For occupations involving great variety of skills and information, the 
upper range will provide better results; for those with fewer major 
areas, the lower limit is satisfactory. A somewhat arbitrary choice 
will have to be made for each occupation cluster. The number of test 
items for each major area are determined from the grid. 

example - Machine Occupations - Assumed number of test items: 164. 

For the Milling Processes and Machines area, the planning 
committee assigned 17% of the total test items. Therefore, 
no less than 28 test items will have to be developed for 
this area. 

No. of test items for area = Total x percent 

N = 167 x 0.17 = 28 



Illustration 3 



MATI0H ^CraATIO»If N ^S OMPETENCY TESTING ™°->ECT 

occ ' u PATIONAL proficiency EXAMINATION 

ACHINE INDUSTRIES OCCUPATIONS (MACHINE TRADES) 
DIRECTIONS TO THE CANDIDATE 
Scope of the Written and Performance Examination 



other =riLii;y% f ‘r l rsi„g?ror a t“r n a Jo^l^tie^ef °pdrp^“e? ” lth 
1 ‘ education programs “ nd ‘"•'-“^‘/technical teacher 



2 , 

3. 



To meet state requirements for certification 

To establish evidence of occupational competence for 
advanced standing in undergraduate or grad^te"^ grams 



They are designed to test the level of skill anrl , , 

candidate in his particular occupational f.eld, 86 ° f the 

experienced people in the same occupation ’ com P ar « d to other 

Two types of examinations are administered. The WRTTtfim 
consisting of mul t iple -cho ice erea * Ihe WRITTEN examination, 

edge and judgements a competent tradesma C ° VerS the information, knowl- 
work. competent tradesman is expected to apply to his 

The PERFORMANCE Pv^indH^ , 

pe tent” tradesman is ^pec^ed Jo bf taSkS * 

I„ h d in Che ,r- inatlM 

WRITTEN EXAMINATT.im 



1. 


Candidates may take thre 
examination. 


e hours to c 


2. 


They will be notified 
the examination. 


as 


to the date 


3. 


A #2 lead pencil must 


be 


provided b 
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Illustration 4 



I. SCOPE OF THE WRITTEN EXAMINATION (Sample section) 

Trade information, theory, facts and basic principles the applicant 
should know 

1 • Bench and Assembly Work, Layout and Inspection (percent of 

the exam 

a) Principles and procedures of layout work 

b) Interpretation of blueprints, drawings - sketches 

c) Principles of inspection and precision measurement 

d) Utilization of precision tools and measuring instruments 

e) Determination of Tolerances, specifications from 
drawings for proper sequence of operations -treatment 
of materials 

f) Hand tool, assembly and bench operations and 
utilization of proper tools 



2. Machine Sawing, Filing and Multiple Parts Processing 

a) Principles of operations 

b) Special functions - filing - internal and external 

c) Cutting tools, blades - friction cutting 

d) Selection of blades, file chains, etc, 

e) Determination of feeds and speeds 

3 * Drilling^ Tapping, Lapping - (Machines and Attachments) 

a) Sizes and capacities of machines and attachments 

b) Single spindle and multiple spindle production 
operations 

c) Principles of precision finishing - reaming - 
lapping 

d) Determination of tolerances and internal finishes 

e) Principles and methods of clamping work 

f) Determination of speeds and feeds 

g) Determination of sizes and kinds of drilling and 
tapping tools 

4. Electrical Discharge Machining 

a) Principles of operation of electronic machining 

b) Operation and adjustment of controls 

c) Determination of limits and tolerances from blueprints 
and specifications 

d) Accuracy, tooling, siz a 




12 %) 



(3%) 



(5%) 



(4%) 
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Illustration 5 



PERFORMANCE EXAMINATION 

The performance part of the examination provides an opportunity 
for the candidate to demonstrate his level of proficiency in the 
manipulative skills and judgements essential to carry on the work of 
the occupation. 

The scope of the performance part of the examination lists the 
skills, methods and procedures typical of the occupations from which 
che work sample jobs have been developed. 

1* Candidates may take five hours to complete the work jobs. 

2. Safety glasses are required and will be provided. 
Candidates may bring their own glasses. 

3* Personal hand tools, such as micrometers and scales 
may be used. 

4. Handbooks or reference materials may not be brought 
into the shop. They will be provided when necessary. 

5. Appropriate work clothes should be worn. 

6. Adherence to safety standards is mandatory. 



II* SCOPE OF THE PERFORMANCE EXAMINATION (Sample section) 

A. Trade skills, methods and procedures of operation the applicant 
should be able to perform: 

I* Bench and Assembly, Layout and Insp ection 

a) Layout of work, including center, reference, 
contour and dimension lines, surface preparation 

b) Using common hand and measuring tools, surface plate, 
vise and other holding or clamping devices, 
precision tools ano gages * 

c) Filing, cutting, reaming, threading, fitting, 
polishing and lapping 

d) Testing and inspecting with precision inspection 
tools — precision blocks, gages, indicators, 
hardness testers and comparator 

2 - Machine Sawing, Filing and Multiple Parts Processing 

Set up, weld saw blades 

b) Cut to a line 

c) Set up and file to a line 

d) Clamp regular and irregular fcftapes 

e ) Sawing and filing angular surfaces 







(15%) 



( 2 %) 
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NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 



WORK SHEET III FOR THE SCOPE OF THE WRITTEN EXAMINATION 
FOR (EXAMINATION TITLE) 



1. Major Area 



% of Total Test Items 



Subdivision 



2. Major Area 



7o of Total Test Items 



Subdivision 



3. Major Area 



7o of Total Test Items 



Subdivision 
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IV. OCCUPATIONAL JOB CLUSTER ANALYSIS 
Cly ster An alys is for S k ills and Infnn.,H„. 

This analysis should be madp ___ 
assisted by a vocational teacher and a t °l SUbject specialists 

show the fundamental skills of the technician. it should 

Cluster, indicate the frequency ^ X ^occupations in the Job 
culty or ..ase in which applied and what ne ^ USed Snd the 
competency of the occupation. It must also ^ Pl J y the OVera H 
technical information derived from th ’ f * ° W the trade 
and communication practices of the occupation! SClenCeS * mat hematics. 

Work Sheet IV has been used effectively 
of the occupational content analysif Carr y ° n this P art 






O 

ERIC 



14 



NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 





15 



i 

I 



V. STEPS IN EVALUATING THE WRITTEN TEST 



Preliminary Testing 

Before pilot testing the examination with a group of candidates, it 
is strongly suggested that the test be administered to one or more indi- 
viduals recognized and respected in the field for competence. This 
individual (s) should take the examination and later evaluate it for con- 
tent, clarity, completeness and recency. This test might well lead to 
some revisions and modification. Such revisions, as may be necessary, 
must be made before the examination is administered to a pilot group. * 

Pilot Testing of the Written Examination 

The completed examination should then be administered to a group 
of 10-15 tradesmen and/or trade teachers. The results must be tabulated 
for analysis and evaluation. Obvious test items can be corrected, 
others will reveal weaknesses through statistical analysis. 

Evaluation of Pilot Test Results for Final Revision 

Through item analysis, reliability and validity computation, a 
final appraisal must be made. Items too difficult, too easy or not 
clear must be eliminated, corrected or revised. A pool of additional 
test items reviewed for appropriateness, difficulty, completeness, etc. 
must be provided. If necessary, the revised form should be adminis- 
tered again. For helpful evaluative suggestions refer to Handbook 
page . 

Final Form of the Written Examination 

The occupational competency examination should be arranged to 
follow the prescribed form which is later included under the directions 
for the test developer. 



VI. STEPS IN EVALUATING THE PERFORMANCE TEST 



Preliminary Testing of the Performance Test 

After the specification or drawing of one or more work job(s) is 
completed and before pilot testing the performance examination on a 
group of candidates, it is necessary to administer the performance test 
to an individual recognized and respected in the field for his compe- 
tence. The evaluation should utilize the evaluation form and reveal 
whether the work assigned is appropriate in methods and representative 
of a certain competency level and whether the evaluation form is practi- 
cal and can be used effectively and unobtrusively by an examiner. Re- 
visions and modifications in the work sample should be made before pilot 
testing. 
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B. 



Pilot Testing the Performance Test 



The performance test should be pilot tested by administering it 
to a group of candidates, the results evaluated, and all necessary re 
visions made before submitting the test in final form. 

C . The Completed Performance Test 



This part of the examination must include: (n the specification 

and/or drawing of the work to be done by the candidate, (2) one alter- 
nate form, and (3) an evaluation or rating form which includes the 
evaluation of a finished product or a completed service, as well as 
the methodology employed. 
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PART TWO 



TEST DEVELOPMENT 



I. DIRECTIONS FOR THE TEST DEVELOPER 

A . Information and Resources for Written Test Item Preparation 

The cluster analysis for the skills and information provides the 
material from which the test items must be developed. The Scope of the 
written and performance examination, sometimes known as the examination 
specification, provides the percentage of the total test items which are 
to be formulated for each sub area. If the test item writer has par- 
ticipated in their preparation, he has them available. If others have 
carried on this work, the area test center coordinator will provide 
these items for him. 



B . Test Item Form - Written Examinatio n 

The multiple-choice type of test item has been selected for the 
written part of the occupational competency test. 

The test item writer should familiarize himself with the structure 
of the multiple-choice item and many different forms. The Handbook on 
the Development and Administration of Occupational Competency Tests: 
Volume 3 provides examples for test item development writing. As many 
variations of this type of test item described in the Handbook should 
be employed in the test to be written. 



C. Construction of the Performance Test 



A quality performance test representative of certain competency 
levels is difficult to construct. Care must be exercised in the selec- 
tion of those skills and methods that are truly indicative of the com- 
petency of the occupation. The test constructor should review the Hand- 
book before proceeding with the construction of the performance test. 



Performance 
(b) specific dire 
a local situation 
evaluation of the 
The procedure for 
information is de 



tests involve (a) instructions for the candidate and 
ctions for the examiner who will administer the test in 
. These must be prepared by the test constructor. The 
performance test requires a special evaluation form, 
preparing the performance test and the supplementary 
scribed in detail in the following pages. 



26 
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D • Constructing the Written Test 
1 • Test Item Preparation 

_• 5 eSt items should be prepared by the subject specialists 

asois :ed by vocational teachers and test specialists. Some conunit- 

that When e^h V" each item ‘ However, experience has shown 
that when each member assumes responsibility for a section of the 

occupationa! cluster and writes a specific number of test items 

which are then reviewed by the whole committee, the work proceeds 
more rapidly. r 

2 . Recording the Test Items 

• The , test items should be recorded on 5 x 8 cards in the manner 
indicated on Work Sheet V. This method of recording expedites the 
item evaluation and the organization of the examination. 

3 * „ T 5 e rev ^? w should focus on clarity of phrasing and complete- 

ness of sampling. A sufficient number of additional test items 
beyond those indicated in the Scope, must be written to provide’ 
for, at least, one alternate form. In the example above, 28 test 
items are required; at least, 75% additional test items are required 

for alternate forms. This review permits revision, elimination or 
additions of test items. 



II. WRITTEN EXAMINATION FORMAT 
Organizing the Examination 

1. A variety of ways have been developed for the grouping of test items. 
For occupational competency tests with different achievement levels 
various areas should be grouped separately in sections. Within each 
section, the sequence of difficulty is to be arranged in random order, 

2. Organizing the test items may well be done by the test technician. 

owever, the committee, as a whole, should review the examination 

for content, ease of reading, and speed ease and accuracy of record- 
ing the answers. 
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WORK SHEET V 



FOR THE PREPARATION OF TEST ITEMS 



E aC h test item should be written on a 5 x 8 card. The information must 
include the major and subdivision of the job cluster, the stfenwof thfetesf 

b^^Xi ^"^""VT^/etc? 68, ^ reSI '° nSe Ch ° iCeS " lUSt be Seated 




The Code should indicate the estimated difficulty „evel of the test item, and 

the frequency of application of the item. The following letters and numbers 
must be used: 



Level of Difficulty 



E * easy 
A - average 
D - difficult 



Frequency of Use 




1 - all the time 

2 - frequently 

3 - occasionally 

4 - seldom 
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Illustration 6 



Directions 



Directions 



0 




NATIONAL OCCUPATIONAL COMPETENCY TESTING PROGRAM 

OCCUPATIONAL PROFICIENCY EXAMINATION 
MACHINE INDUSTRIES OCCUPATIONS 
(MACHINE TRADES') 

DIRECTIONS TO THE CANDIDATE 

WRITTEN - FORM A 



: (NO MARKS ARE TO BE MADE IN THIS EXAMINATION BOOKLET.) 

Your name, identification number, and answers for all items 

are to be marked on the IBM answer sheet provided with this 

examination. Use a #2 lead pencil to make all marks on the 

answer sheet. 

A. Print your name in the space on the top of the answer 
sheet. 

B. Copy the Booklet Number from the upper right-hand corner 
of this page in the space provided for "Grade" . 

C. Enter today's date in the appropriate space. 

D. Enter the name of the place, in which you are taking 
the examination, in the space after "city". 

E. Copy the name of the test and the form letter in the 
space for "Name of Test". 

F. Note the boxes below the red arrow on your answer sheet. 

Use these boxes to record your Social Security number. 

Then blacken the appropriate spaces to the right to cor- 
respond with the numbers in each box. 

for Recording Answers : 

1. To mark each answer, make a heavy, black mark in the answer 
space next to the letter of the answer you think is correct. 
(NOTE: Items proceed in columns from left to right on the 
answer sheet.) ' 

If you wish to change an answer, erase the old answer 
completely, then make a heavy black mark for the answer 
you think is correct. 

3. Mark only one answer for each item. You should answer all 
items, since there is no penalty for guessing. Do not 
erase, fold, or make any/^ttfay marks on the answer sheet, 
since this may lower your score. 

4. Time limit 3 hours. 

29 
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Preparation of an Answer sheet 



-The answers must be so designed as to indicate random order 
The examinee must not b e able to recognize or identify a pattern to 
the correct answers. The answers are to be indicated by capital 
letters rather than numbers. The answer sheet must be scorable by 
^ectronic data processing equipment. Scoring must be done efficient 
ly, accurately, and confidentially. Illustration 8 represents a 
typical answer sheet. 



Illustration 8 

NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 
OCCUPATIONAL PROFICIENCY EXAMINATION 
ELECTRONIC COMMUNICATION 



KEY TO ANSWERS FOR WRITTEN TEST - FORM A 



1 . 


c 


26. 


A 


51. 


D 


76. 


B 


2. 


B 


27. 


D 


52. 


D 


77. 


A 


3. 


D 


28. 


B 


53. 


A 


00 


C 


4. 


C 


29. 


A 


54. 


B 


79. 


B 


5. 


D 


30. 


B 


55. 
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o 

00 


A 



25. B 



50. 



B 



75. B 



100 . 
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HI. CONSTRUCTING THE PERFORMANCE EXAMINATION 



A . Selection of Skills for t he Work Job 

From the content 3nalysis , the committee must select a series of 
skills that are representative of the typical work jobs of the occupa- 
tion. These skills must be representative of certain levels of com- 
petency. Care must be taken to have a sufficient range of skills. 

Highly specialized or unusual skills or tricks not typical or repre- 
sentative of certain levels of competency must be avoided. 

B . Selection of Work Jobs 

The performance test should provide an opportunity for the exam- 
inee to demonstrate his skill and the methods employed by a competent 
individual. For some occupations the finished product reveals both 
the skills and the method; for others, the simulation work sample is 
more appropriate and for still others the troubleshooting approach 
is required. The committee must make a choice as to which is most 
appropriate for a particular occupation. 

C . Description of Work Jobs 

The performance tasks must be clearly described, the length of 
time for each work job estimated and sketches/drawings prepared. 

Work Sheet VI has proven to be effective in the preliminary 
planning and revision of performance tests. 

D. Directions to the Candidate for the Performance Test 

Most performance tests require certain instructions to the candi- 
date. He must know: 

1. The reference material he may use, 

2. Any special information, characteristic of his occupation 
that he needs to be told, 

3. The number of work jobs he is expected to complete, 

4. The minimum and maximum time limits established for the performance 
examination, and 

5. Any special directions the candidate may need when a work sample is 
not required to be completed. 

Illustration 9 shows an example of such directions and Illustration 10 
a typical drawing of a work sample job. 
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NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 



WORK SHEET VI FOR PERFORMANCE TEST 



Occupation 



Time 



Major Area 



Subdivisions 



1. Work Sample Test 

Sketches, Drawings, Wiring Diagrams, Circuits, 
specifications that show clearly what is to be 
done and completed. 



2. Simulation Performance Test 

Must provide a clear description of the equipment, 
apparatus involved in the simulation. State speci- 
fically what method, procedure or technique is to 
be included in the simulation; also, the tools, 
materirls and accessories required and the level 
of performance. 



3 . Troubleshooting 



Must provide a clear statement of the equipment to 
be used, the nature of the trouble to be introduced 
and the method by which it is to be accomplished. 

A statement must be included as to what particular 
competence is to be demonstrated in locating and 
correcting the induced trouble. Tools, accessories 
and supplies should also be listed. 
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WORK SHEET VII FOR THE SELECTION OF MANIPULATIVE SKILLS 
FOR THE DESIGN OF PERFORMANCE TESTS 



Major Occupational Area 



Subdivision 



Skills and/or Methods 

A. 1. 

2 . 

3 . 

A. 

5 . 



B. 1. 



2 . 



3 . 



4 . 



5 . 



C. 1. 



2 . 



3 . 

4 . 



5 . 



D. 1. 



2 . 

3 . 

4 . 

5 . 
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Illustration 9 



NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 
OCCUPATIONAL PROFICIENCY EXAMINATION 
MACHINE INDUSTRIES OCCUPATIONS 
(MACHINE TRADES) 

DIRECTIONS TO THE CANDIDATE 

PERFORMANCE TEST - FORM A 



Name and Number 

Maximum time - 5 hours 



Note : 



1- The use of Handbook will be permitted. 

2. The order in which the jobs are to be completed depend upon the 
shop facilities , end are determined by the examiner. 

3. The candidate should follow his normal pattern of work to which 
he is accustomed in the trade. If any problems develop or ques- 
tions arise, the examiner must be advised and consulted. 

4. The candidates are expected to complete all jobs assigned to the 
performance test. 

5. The candidate should ask the examiner for anything he needs, if 
it has not been provided. 



Job I. Perform the necessary machining operations on the blank furnished 
by the examiner for the part shown on the attached drawing: 

1# Square up part 

2. Grind end and one narrow side square according to drawing 

3. Mill slot - check with examiner before cutting 

4. With precision tools, lay out location of holes and center mark 

5. Drill and ream holes to size 

6. Turn in paper used in computations with finished work piece 
Job II. M achining part on lathe 

1. Grind tool bit blanks, furnished by examiner, on a pedestal or 

bench grinder for use in machining Job II shown on the attached 
drawing . 

2. Set up milling machine for cutting slots in edge of part, as 
shown oi, drawing. 

(a) Have examiner check the dividing head setup. 

3. Lay out, set up and drill hole for tapping. 

4. Turn in paper used in computation with finished v;ork piece. 
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n 



Job III. Drill Grind! n p 



Job IV. 



1 . 

2 . 



3. 



Obtain a drill 1/2" diameter 
Grind drill by the off-hand 
bench grinder to obtain the 
Return drill to examiner. 



or larger from examiner, 
method on a pedestal or 
standard cutting edge angle. 



Refer to print of Job III (part should be fac 
drilled) . 



ed 



and 



center 



1 . 

2 . 



r uwilcl LttA 

The thread should fit the nut 



rerrorm tne necessary 
furnished by the examiner, 
furnished. 

?/«hV“ Sh ? Per 2 nd CUt 3 flat on the 1 “ 1 / 2 " diameter part 
3/32 from circumference. This is optional - check with 
the examiner. UI1 



At the close of the examination, turn in: 

1* All prints and instructions 

2. Sheets with computations 

3. Drawings I - II - m 

4. Three tool bits 

5. One drill 
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IV. EVALUATING THE RESULTS OF A PERFORMANCE TEST 



Developing a Rating Form 



The performance test should not 
complete an assigned test but, also, 
efficient and acceptable methods. 



only reveal that a candidate can 
whether he has mastery of the most 



Some occupations permit more objective evaluations than others. 
Frequently, more than one examiner is required to test a group of can- 
didates. To assure that all candidates are evaluated on the same items 
it is necessary for the test development committee to develop an evalu- 
ation form with a rating scale. Such rating form includes an appraisal 
of the important steps in the methods employed and an evaluation of the 
fnished product. 



Work Sheet VIII has been used to list the factors essential to 
both method and finished product evaluation. 



Work Sheet IX has been used for evaluating the methods and tech- 
niques employed in locating and correcting malfunctions in equipment or 
apparatus. Illustration 11 represents a sample rating sheet for a work 
sample te3t and Illustration 12 a sample rating for a group of trouble- 
shooting tasks. 
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NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 



WORK SHEET VIII FOR PERFORMANCE TEST-FINISHED PRODUCT 



EVALUATION FORM FOR: (Occupation) 

Work Method and Finished Product Evaluation 



Steps of Methods to be 
evaluated 



i-i'.-tns of Finished Product to be 
eval . ated 



Major Area 

1 . 

2 . 

3 . 



Point Value 

( ) 

( ) 

( ) 

( ) 

( ) 



1 . 

2 . 

3 . 



Point Value 

( ) 

( ) 

( ) 

( ) 

( ) 



Total Value 



Total Value 



Major Area 

1 . 

2 . 

3 . 



( ) 1 . 

( ) 2 . 

( ) 3 - 



( ) 
( ) 
( ) 



Total Value 



Total Value 



Final computation of the score 
Special conditions to be observed 
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NATIONAL OCCUPATIONAL COMPETENCY TESTING PPOJECT 
OCCUPATIONAL COMPETENCY EXAMINATION 
( MACHINE TRADES ) 
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Points 



Factors 



4 Worker inept or out of practice 

8 Worker with below average or limited facility 

10 Average worker in the field 

18 Good, above average worker 

20 Extremely able, competent worker 

The same^proportions apply whether the ratings are indicated as 0-5, 

Please state your overall impression of the candidate as a worker in 
the field in the addition to the above score. 



(The above is printed on the back sheet of Illustration 11. '» 
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NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 
PERFORMANCE EVALUATION 

WORK SHEET IX FOR PERFORMANCE TEST- - TROUBLESHOOTING 
EVALUATION FORM FOR 

Trouble shoo ting and Diagnostic Techniques 

Steps of troubleshooting Score to be 

to be evaluated assigned 

Major Area 



( ) 

( ) 

( ) 

( ) 

Major Area 

( ) 

( ) 

( ) 

( ) 

Computation of Final Score, 

Special Conditions to be observed. 
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Illustration 12 



NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 
OCCUPATIONAL COMPETENCY TEST 
ELECTRONICS INDUSTRIES OCCUPATIONS (COMMUNICATION) 



EXAMINER'S PERFORMANCE EVALUATION SCALE 



Candidate's Name and Number 



Place 



Date 



While the candidate is performing the assigned tasks, rate his performance on 
each job on the scale shown below, indicate any weaknesses in the last column. 



The candidate should be rated on two features of his performance: a) his work 
methods, and b) the finished job. The following seven aspects of his work 
methods are to be used: 



1. Does he approach the identification and location of the trouble 
systematically in a step-by-step manner? 

2. Does he use the accepted trade method in correcting the trouble? 

3. Does he select test equipment properly? 

4. Does he perform hand tool operations skillfully? 

5. Does he work neatly, accurately and safely? 

6. Does he work at an acceptable speed? 

^ * Does he avoid excessive and inappropriate use of reference material? 

In assigning ratings to the job performance, remember that the scores indi- 
cated are maximum and should be given only to the extremely competent candi- 
date. (For a breakdown see the following sheet./) 



Work Methods and Finished .Tnh 


Max. 

Score 




. Jobs 


Comments : 
Weaknesses 






1 


2 


3 


4 


1,51 


6 


7 


8 


a- 1 


Procedure in identifying and 
locating trouble 


20 




















2 


Method of correcting trouble 


15 




















3 


Selection and use of test 
equipment 


10 




















4 


Skill of hand tool operations 


10 




















5 


Neatness, accuracy and 
safety of work 


5 




















6 


Speed 


5 




















7 


Use of reference materials 


5 




















•b- 


SCORE FOR WORK METHODS 
SCORE FOR FINISHED JOB 
Total Score 


70 

30 

100 


















1 



Final Score 



Add all columns 
No. of Jobs 



Final Score: 



Examiner 1 s Signature 

43 



35 



RATING DISTRTRTTttom 



4 - Worker inept or out of practice 

8 - Worker with below average and limited facility 

0 - Average worker in the field 

8 - Good or above average worker 

° - Extremely able, highly competent worker 



The same relationship should 
15 or 10 or 5. 



prevail when the maximum scores are 



----- 80 ab °- 



(The above is printed on the back of Illustration 12. 'i 
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v. DIRECTIONS to the examiner 



The candidate is entitled to know what he is being tested on. 
This information is presented in the Scope of the Written and Per- 
formance Examination on each examination: The examiner who admin- 

isters the performance examination must prepare the shop or labora- 
tory for this test. He must know the materials and supplies needed, 
the tools, accessories required, and the machines, apparatus and 
instruments on which the candidates are to be tested. 

Illustration 13 shows general directions to the examiner for a 
performance test followed by Illustration 14 which shows a listing 
of jobs, machines, accessories required for each job and Illustra- 
tion 15 is an example of the listing of tools ; accessories and ma- 
terials required. Preparing such listings facilitates the prepara- 
tory work of the examiner. 

Work Sheet X provides a convenient way for the test constructor 
to list all the items indicated in Illustrations 13-15. 
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NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 



Directions to the Examiner - Performance Test 

WORK SHEET X - DIRECTIONS TO EXAMINER : (occupation) 

(To be used by Test Constructors to direct the examiner in the preparation 
of the shop or laboratory for the performance test.) 



Job I. Provide the following: 
A. Materials 



B • Machine 1. (include all necessary tools and accessories) 



C. Machine 2. (include all necessary tools and accessories) 



D. Machine 3, (include all necessary ^ools and accessories) 




■?6 
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Illustration 13 



NATIONAL OCCUPATIONAL COMPETENCY PROJECT 
OCCUPATIONAL PROFICIENCY EXAMINATION 
MACHINE INDUSTRIES OCCUPATIONS 
(MACHINE TRADES') 

GENERAL DIRECTIONS TO THE EXAMINER 
PERFORMANCE TEST - FORM A 



Estimated maximum time - 5 hours. 

I. Study the Scope and Directions to the candidate. 

J. Study Manual for Administering Proficiency Examinations. 

3. Use only the Performance Rating Sheets provided. 

4. The purpose of this examination is to measure the candidate's occupa- 
tional competency. No other judgment should be exercised. It is NOT 
the responsibility of the examiner to decide whether or not the candi- 
date has teaching potential. 

5. Do not allow candidates to discuss problems with each other. 

6. Specific problems have been designated to test the candidate's ability 
to operate machines, use tools, etc. Do not alter the nature of the 
problem by substituting a different problem. 

/• If facilities are available, permit the candidate to select the type of 
machine or tool he desires to use. 

8. Provide such information, as drawings and handbook, that may be needed - 
also, the necessary tools, materials and accessories. Inform the candi- 
date that they are available. 

9. If it is quite apparent that the candidate is not skilled enough to per- 

form the assignment, encourage him to move on to another assignment and 
then come back to the discontinued one if time permits. 

10. Make sure that, all machines, tools and equipment used for the test are 

in satisfactory working order, and are not specially set up. 

11. Check the operation of each machine or equipment, after a candidate 

completes his work, to be sure it is in readiness for the next candidacc. 

12. Do not assist any candidate or make suggestions. If it is apparent that 
he is damaging any machines or equipment, you may interrupt the procedure 
to prevent this. Allow the candidate to complete the assignment, b’u. 
record what has taken place on the rating sheet. 
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Illustration 14 



NATIONAL OCCUPATIONAL '"""‘MPETENCY PROJECT 
OCCUPATIONAL PROFICIENCY EXAMINATION 
MACHINE INDUSTRIES OCCUPATIONS 
(MACHINE TRADES) 

DIRECTIONS TO THE EXAMINER 

PERFORMANCE TEST - FORM A 



Listing of Machines,, Accessories and Materials Required for Each Job . 

Time Limit - 5 hours . 

This list has been prepared for your convenience, to be used in preparing 
the shop for the performance test. The candidate must be provided with 
the following items for each job. Determine the sequence in which the jobs 
are to be done, according to the machines and grinders available in the 
shop. Instruct the candidates as to the order of jobs in which to proceed. 

Job I: Provide the following machines, accessories, tools and materials: 

A. Material - For each candidate provide one piece of cold 

rolled steel, 1/2 x 2 x 5-1/8 plus extras. 

B. Surface Grinder - with suitable wheel and guards. 

Magnetic chuck Safety shield or goggles 

Wheel dresser Angle plate or precision 

Clamps - parallel or "C" vise 

Single cut or fine file Solid steel square 

or oil stone 

C. Milling Machine - vertical or horizontal. 

Vise 

Parallels 

Soft face hammer 

Uni ersal indicator 

Milling cutters 3/8 - 5/16 - 1/4 

Blocks and straps 

Suitable tools to measure slot (vernier caliper, small 
hole gage, micrometer, adjustable parallels, inside 
calipers ) . 

A-sorted 3/8" reamers. 

Vertical miller if used - drill chuck and adapters, 
center drill, set of letter drills 
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D. 



Layout Table or Bench 



Layout fluid 
Vernier height 
Bevel protractor 
Center or prick punch 
Angle plate 
Dividers 



E. Drill Press 



Surface plate 
Combination square 
Sine bar (Jo-blocks or 
planer gage) 

Ball peen hammer 

6" Ruler 

0~1 M Micrometer 



Drill vise 

Soft face hammer 

Letter drills 

Cutting fluid 

Fine file or oilstone 



Parallels 
Center drill 
Assorted reamers 
Brush 



Estimated time - 1 hour 10 minutes 



The completed work pieces, drills and tool bits must be s- 
in an envelope, checked and graded by the examiner at the 
the performance test. 



.omitted, placed 
conclusion of 



Eac i envelope must he properly identified with 
nupr/oer, and the examine : f s signature. 



the candidate r s name 



and 
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Illustration 15 



NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 
OCCUPATIONAL PROFICIENCY EXAMINATION 
MACHINE INDUSTRIES OCCUPATIONS 
(MACHINE TRADES) 

DIRECTIONS TO THE EXAMINER 

PERFORMANCE TEST - FORM A 



Listing of Tools, Ac cessories and M aterials Reauired 
Test. a 



for the Performance 



Time limit - 5 hours . 



nation^^hrrri 1611 ^ prep f rl "f the f ' ^s for the performance exami- 

h, i L PH S 8 / e r r iSt ° f ac ' -**or^s, tools and materials has 

been prepared. When tools or accessories are used for an operation on sev- 

examiner must arrange for the number required and how to 
interchange them among the candidates when they are needed. 



” One for each candidate, plus several spares. 

Job I: 1/2” x 2” x 5-1/8” cold rolled steel. 

Job II: 1-3/4” diam. x 1-5/8” low carbon machine steel 

Job III: 1-1/2" diam. x 5 ’1/2” long low carbon machine steel 
faced and center drilled at both ends 
Job IV: One drill - 1/2” or large- - cutting edge dulled 

II. Machine - 



A * 1)1:111 press - Drill chuck of appropriate capacity, drill 

vise - V-blocks, parallels, coolant and 
brush 

B. Ioathg . - Chucks, drive plate, centers, tool holders 

(turning, parting, boring), micrometer stop 
(optional), tap red sleeves, taper attach- 
ment (if available, in sufficient numbers), 
ir3 taper gage (optional), dogs, coolant and 
brush . 

C. Milling Mach liie - Vertical or Hon^.nnfal 




Vis^ 

Index head (40 to 1 ratio) 
Set ot index elates 
Wrenches 
Screwdrivers 



Blocks and straps 
Coolant and brush 
For vertical miller 
appropriate chucks 
and end mills 



D Surface Grinde r 



Suitable wheel 
Magnetic chuck 



and 



guards 



Precision hand vi sc 
Wheel dresser 
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1 3- 1 * Tools & Accesso r i e s - 



Microme ter s 



6 M scale 

0- l M ) 

1- 2 ft ) 

Vernier calipers 
Vernier height gage 
Dial indicator 

Drill point gage or bevel 
protractor 
Inside calipers 
Telescoping gage 
Hermaphrodite calipers 
Dividers 

Combination square set 
Solid square -appropriate 

size \ 

Beve' : protractor 
Sine bar 6c Jo-Blocks - if not 
available , provide 
Planer gage 
Surface plate 
Angle plate 

Assorted pair of parallels 
Parallel and C f .V- clamps 
Bench drill vise 
V-b lock- -suitable size 
Center drills- -appropriate 
size 



Depth micrometer or vernier 
caliper 

Thread micrometer 
Thread gage 
Pitch gage 

Small .hole gage or 3/8 tf 
dowel pin 

Set of fraction drills 
Surface gage and scriber 
Center prick or marking punch 
Small ball peen hammer 
Layout fluid 
3/ 8" drill 

Drills 1/2 M or larger 
One set l/4”-2C taps 
Tap wrench 
Countersink 
Scraper 

Assorted wrenches--screwdr ivers 
Soft-faced hammer or mallet 
Fine cut tiles or oilstone 
Chip brush 6c coolant 
3 tool bit blanks (pre-identif ied) 
Set of letter drills 
Set of number drills 
Set of 3/8" assorted reamers-- 
(oversize, undersize, correct 
size ) 



A « Milling Machine - Vertical or Horizontal 



Vise 

Index head (40 to 1 ratio) 
Set of index plates 
Wrenches 
Screwdrivers 



E • Surface Grinder 



Suitable wheel and guards 
Magnetic chuck 



Blocks and straps 
Coolant and brush 
For vertical miller 
appropriate chucks 
and end mills 



Precision hand vise 
Wheel dresses 



P r o v ici e safety gu ar ds anu/or goggles. 

Let the candidate make his choice of methods, tools or accessories whenever 
practical 

Advise the candidate to ask for tools and accessories which he d sires, but 
are not included in the list. The examiner should record such a -^quest and 
report in his evaluation on the appropriateness of the request. 
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PART THREE 



ADMINISTERING OCCUPATIONAL COMPETENCY EXAMINATIONS 



Information necessary for preliminary preparati 
scoring of written and performance occupational 



on, administration and 
competency examinations. 



I. GENERAL INFORMATION FOR THE EXAMINERS 



is tered 



The proficiency examinations are divided into two separately admin- 
ed tests: (a) the written test, and (b) the performance test. 



The written test is usually administered 
~ants . The performance examination is given 
supervision and observation. 



to a large group ol appli- 
to small groups with greater 



The scoring of test items on the written examination will he done 
by machine. 

For the performance examinations, the scoring is more subjective 
and judgments must be made by the examiner as he observes the candidate's 
performance and records the observations and performance on a special 
scoring form with each examination. 



A. Testing Procedures 



Testing procedures must be uniform in all locations and by *11 
examiners to insure comparability of test results. The procedures 
should be followed, even though they may seem cumbersome to the ex- 
aminers. If, f or any reason, an irregularity occurs, a description 
of the nature of the irregularity should be noted in the appr. -riate 
section on the Examination Report. 



B . Identification of Candidates 



Examiners will be furnished with a 
Security Numbers and the specified test 
tested. 



list of names and Social 
for persons who are to be 



Candidates are provided with admission notices; showing name, 
address. Social Security Number, and the name of the occupation. 
Candidates appearing without admission notices, may take the exam- 
ination, if their names are on the list of candidates or its supple- 
ment . rr 




Candidates who are more than 45 
admitted. An extension of time may 
the lateness is due to difficulties 
distances or when time and place of 
adequate notice. 



minutes late she ild not be 
be granted to individuals, if 
encountered in traveling long 
examination are changed without 
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For candidates who are late, note the tjme of starting or. the 
Examination Report, under "Individual Irregularities". 



II. DIRECTIONS FOR ADMINISTERING THE WRITTEN EXAMINATION 

Things for the Proctor to Do Prior to the Examina Ion 

1 • Obtain specific directions relative to proctoring the written 
examination . 

2. Obtain list of candidates exp. -Led for the examination. 

3. Obtain examination papers, answer papers and other materials 
needed for the test. 

Before the Examination Begins 

1. Check condition of the examination room for proper heat, light, 
ventilation and adequate seating facilities and enter irregu- 
larities on the Examination Report. 

2. Require candidates to identify themselves as they arrive. 

3. Two candidates, taking the same examination, must be seated 
away from each other. 

4. Supplies not specifically required for the examination ire not 
permitted . 

5. Check to be sure each candidate has a pencil or is given one 
by the examiner. 

6. If other supplies, such as handbooks or slide rules, are sug- 
gested, the proctor should have a supply available for those 
candidates who did not bring them. 

Distribution of Examinations 

1 • Make any special announcements that may be required. 

2. Be sure all candidates are seated and ready to begin work. 

3. Hand to each candidate the appropriate examination envelope. 

Do not allow the envelopes to be opened or any work to begin 
until you have given the "start" signal. 

4. Say to the candidates, "Take the examination out of the envelope 

(Pause) Put your Social Security Ni her on the line for the 
Name or Number and today's date, which is . Your 

name should not be put. on the booklet, unless you do not know 
your ucial Securi Ly Number. (Pause) Make sure your Social 
Security Number is entered cn all work you hand in to the ex- 
aminer. After you read the directions, yon may begin work. 
Before leaving.* place all your work and papers into the exam- 

cro 



D . 



NOTE 



L n “ieck e ":^° P ^ u ^: r „“"? letl "?H the eI "” inaCi °'' “■* “re ready 

out first checking 5L ■ “* “““• 

Wav to DO During the Examination P eriod 

1. Note the time when examination begins. 

2. Permit no more than one candidate to leave the room at any one 

3. No candidate may leave the room u 

the same test has chicked ” ^ P0rS ° n takln * 

4. Be courteous if questions arise, but do not interpret tha • „ 

or meaning, of a test auactiar, n ^ ? interpret the intent, 

the car' »te. Suggest that -ha ! a°I §1Ve ^ in£ormat i°n to 
as best i a ;. SUggest that - he candidate answer the question 



5. 



If questions arise concerning possible errors in item* 'a a 
spelling, wording, ambiguity or errors in the alternative O ’ 

Sif%rnsL2: ^ :— lc to 

Ansuar rha item as* 

item error.) However, enter any possible error on the 
Examination Report in the Irregularities Section ^ 



ni/h**? cicculate quietly around the room, 

not be left unsupervised. 



The room may 



7. Stop work at the expiration of the allotted time, except for 
those who have official permission to continue. 

8 ' (a/Hhe's™^ Che=k ° Ut ° £ the exa mination room, be sure rha* 
and ar £y Numb " J la « the e minati™ an«Ir 

” PerS ’ ^ (b> SU -“«*•*• “re 

*' Ret “ rn 311 eJca ®ination papers to the appropriate authority. 

III. DIRECTIONS FOR ADMINISTRATION OF PERFORMANCE EXAMINATIONS 
‘ eSmINmS IS RES -° NSIBLE F0R PREPARATION NECESSAR1 FOR THE 

fully I Ll 1 Lw^? 1 “e e , 1 ;L«”s“r a L t ^ s e the f ° U ™ in * “eps b ‘ unre- 
difficulties in administer inland C scorinc° the UreS “"i. 1 "" *" 

complete each of the following steps chLk thVTtlTo'T' + 7 °* 
Examination Report form o n h _ ® oz£ on the 

lari tie* in Kf ’ ’ record a ^y problems oi irregu- 

lanties. In this way, yo u will be adequately prepared for Ih 

delays ’ & °" d needless hardships and time-consuming 
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If you encounter any difficulties which you cannot handle in pre 
paring for the^ examination , contact the appropriate person immediately 
so that the problem can be solved prior to the date of the testing. 
Someone will check, prior to the date of the examination, to be sure 
that everything is ready, and will, also, check with you during the 
actual administration of the performance examination, since unexDected 
problems may arise. P 



Faci J ities for Examinations 

Performance tests should be conducted in shops, or laboratories 
equipped with appropriate and sufficient machinec, equipment, hand tools 
and materials. Shops may be located in vocational schools or selected 
industrial establishments. 

Specific directions, for conducting examinations for each occupa- 
tion, will be placed in the hands of the examiner well in advance of 
the date of the examination. 

In. any case, he should analyze the test problen ' to determine 
amount and type of tools, equipment and other items needed for the num- 
ber f*£ persons scheduled to take the te-t. When the best available fa- 
cilities are inadequate, arrangements suould be made to supplement those 
at hand and bring additional equipment in order to conduct the test 
under the best pcs^* T le conditions. 

Supplies for Testing 

Prior i-o the examination, the examiner shr Id determine the materi- 
als and supplies ne£*ded to conduct the tests. in cases where supplies 
are not readily available and must be purchased, the examiner should 
consult the appropriate person. 

What to Do Before the Day of the Examinati on 

1. Read the "Directions to the Examiner’ ...J "Performance Examination" 
for the examination being given. 

2. Check to verify arrangements for time and place of the examination. 

3. Visit the testing center to be sure that all equipment and tools 
necessa-rv for the test are available. 

4. Check all equipment to make sure that it is in good working 
condition. 

3. Set up all tools, machines, equipment and working conditions, as 
nearly identical as possible, at each work station. 

6. Prepare all partially completed test pieces and/or install defects 
or malfunctions into equipment for troubleshooting for the examin- 
ation. 

Check to make sure th%t all tools, materials and supplies are in 
a convenient i ocation'for each examinee. 



7 . 



8. 



9. 



Place all test materials in a 
mark it with candidate's name 



large envelope for each candidate and 
and Social Security Number. 



Familiarize yourself with the scoring procedures. 



THE ABOVE STEPS ARE TO BE COMPLETED AND RECORDED 
REPORT: PRELIMINARY CHECK- LIST FOR PERFORMANCE 

THE DAY OF THE EXAMINATION. 



ON THE "EXAMINATION 
EXAMINATIONS" BEFORE 



® • What t o Do During the Examination 

1 * «^h r h- aCtUal W °? begins ’ Permit the examinee to acquaint himself 

^ h t 1S ,r r r S * nce the ShOP may be stran 8 e to him. Point- 

u the location of such facilities, as Metrical outlets, ser- 
vice facilities and other physical detail. 

Note the time eacii job is started and finished by each candidate. 

Observe the candidate at his work. Check his work methods quietly 

* a ^conspicuously. Keep a record for your own purposes as the 
examination progresses. 

Spend approximately the same amount of time with each candidate, 
candidate. * teP ° f the j ° b 35 ifc is dieted by each 

Tag or stamp each completed job with the candidate's number. 

Maintain an impartial attitude at all times. it eliminates criti- 
cism and aids in reducing tension which, quite naturally, develops 
during the examination. ps 

8 ‘ ll°^ ide handbooks » reference tables, etc., required in the exami- 
nation. 

9. Carefully record all ratings required on the "Perf >rmance Rating 
and Summary" form for the specific field. S 

Wiat to Avoid During the Examinat m 

1. Allow no more than one examinee to leave the room at any time. 

2. Permit no work to be taken from the shop during the examination. 

o. If an y questions are raided concerning the meaning or indent of a 
job assignment, suggest that the candidate proceed according to 
his understanding. 6 

4. Mark rating sheets away from the candidate. 



2 . 

3. 

4. 

5. 

6 . 
7. 
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5. Refrain from giving any information to a candidate concerning his 
progress or the probable result of the examination. 

6. Refrain from discussing such matters as a candidate ! s occupational 
experience, his education, or personal problems. 

F • At the Close of the Examination 

1. Stop the work at the expiration of the maximum allotted time. 

2. Collect all examination forms and directions. 

3. Identify all test pieces with candidate 1 s number. 

4. Retain all finished work. 

G. Completing the Scoring of the Examination 

1. Most of the performance ratings can be made during the examination. 

2. Inspect and rate all other completed work immediately after candi- 
dates have departed from the shop. 

3. Use only the performance rating sheets provided. 

4. Enter comments which have a bearing on the competency or the candi- 
date on -'e back of the sheet. This is particularly important in 
cases wher Ihe performance is below average. 

5. Sign the raizing sheet in place provided for 11 Examiner" . 

6. Return all scoring sheets, r.uestion papers, prints and other mate- 
rials which will be provided for each examination. 

7. All totals will be computed at the National Occupational Competency 
Testing Project. 
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Illustration 16 



NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 

- EXAMINATION REPORT: P RELIMINAR Y CHECK-LIST FOR PERFORMANCE R FXAMIHAT TON 

Complete each atop as listed b.l«, filling in the date „hen completed. 




Have read "Direct-ions to the Examiner" which are 
specific to the examination being given. 

Have read over the "Performance Examination", which 
is the actual examination the candidates take. 

Arrangements for the cime and place of the examina- 
tion have been verified with the Regional Coordi- 
nator. 



Visited testing center to be sure that all equipment, 
materials and tools necessary for the test are a- 
vailable. (See: "Directions to the Examiner" and 
the Performance Examination" for the specific items 
that will be needed.) 

All equipment has been checked and is in good 
working condition. 

Tools, machines, equipment and working conditions 
have been set up, as nearly identical as possible, 
at each work station. 

All partially completed test pieces and/or defective 
equipment for troubleshooting are prepared and ready 
for the examination. 



Tools, materials, handbooks and supplies are in a 
convenient location for each examinee. (This should 
be similar to the typical work situation where he 
would select equipment from a choice of tools and 
supplies normally available. However, the examinee 
should not be required to spend time in securing 
stock and performing other preliminary work.) 

Job assignments, necessary drawings and other written 
directions, relating to the test, have been placed in 
a large envelope and marked with the candidate's name 
and Social .Security Number. Partially completed 
items are available for the candidate. 



I have completed the above steps, 
cedures I am to follow during the 
Reg Iona 1 Director. 



complexly familiarized myself with all pro- 
examination and have verified this with the 



Signature 



Date 



(If there are any problems related to the above 
blems in administering the examination, cpptact 
testing program.) 
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steps, or if you see any pro- 
the coordinator of the 



Illustration 17 

NATIONAL OCCUPATIONAL COMPETENCY TESTING PROJECT 
OCCUPATIONAL PROFICIENCY EXAMINATION 

SAMPLE REPORT FORM OF IRREGULARITIES 
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